DISCOVERING PERMUTATION PATTERNS 

Field of the Invention 

The present invention relates to pattern discovery and, more particularly, 
5 relates to discovery of permutation patterns. 

Background of the Invention 

A permutation pattern is a pattern where the characters in the pattern can 
be in any order. For instance, in the input string, S = abc.cab, a permutation pattern can 
10 be described as {a,b,c} and the permutation pattern occurs at locations 1 and 7 in the 
input string. Permutation patterns have a variety of practical uses. 

For example, genes that appear together consistently across genomes are 
believed to be functionally related: these genes in each other's neighborhood often code 
for proteins that interact with one another, suggesting a common functional association. 
15 However, the order of the genes in the chromosomes may not be the same. In other 
words, a group of genes appear in different permutations in the genomes. For example in 
plants, the majority of snoRNA genes are organized in polycistrons and transcribed as 
polycistronic precursor snoRNAs. Also, the olfactory receptor(OR)-gene superfamily is 
the largest in the mammalian genome. Several of the human OR genes appear in clusters, 
20 with ten or more members located on almost all human chromosomes. Furthermore, 
some chromosomes contain more than one cluster, where a cluster has one or more 
permutation patterns. 

As the available number of complete genome sequences of organisms 
grows, it becomes a fertile ground for investigation along the direction of detecting gene 
25 clusters by comparative analysis of the genomes. A gene G is compared with its orthologs 
G' in the different organism genomes. Even phylogenetically close species are not 
immune from gene shuffling, such as in Haemophilus influenzae and Escherichia Coli. 
Also, a multicistronic gene cluster sometimes results from horizontal transfer between 
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species and multiple genes in a bacterial operon fuse into a single gene encoding 
multi-domain protein in eukaryotic genomes. 

If the functions of genes, say G1G2, are known, the function of its 
corresponding ortholog clusters G 2 G { may be predicted. Such positional correlation of 
5 genes as clusters and their corresponding orthologs have been used to predict functions of 
ABC transporters and other membrane proteins. 

The local alignment of nucleic or amino acid sequences, called the 
multiple sequence alignment problem, is based on similar subsequences; however the 
local alignment of genomes is based on detecting locally conserved gene clusters. A 
10 measure of gene similarity is used to identify the gene orthologs. For example, genes 
G1G2G3 may be aligned with G\(j 2 Cj^ and such an alignment is never detected in 
subsequence alignments. 

Domains are portions of the coding gene (or the translated amino acid 
sequences) that correspond to a functional sub-unit of the protein. Often, these are 
15 detectable by conserved nucleic acid sequences or amino acid sequences. The 
conservation helps in a relative easy detection by automatic motif discovery tools. 
However, the domains may appear in a different order in the distinct genes giving rise to 
distinct proteins. But, they are functionally related due to the common domains. Thus 
these represent functionally coupled genes such as forming operon structures for 
20 co-expression. 

Thus, it can be seen that it would be useful to determine permutation 
patterns for genes or proteins. Consequently, there is a need for improved techniques for 
determining permutation patterns. 

25 Summary of the Invention 

The present invention provides techniques for determining permutation 

patterns. 

In an exemplary aspect of the present invention, a new portion of an input 
string is selected. The input string has a number of characters from an alphabet. The new 
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portion differs from a previously selected portion of the input string by one or more new 
characters of the input string. One or more values are determined for how many of the 
one or more new characters are in the portion of the input string. It is determined which, 
if any, names in a number of sets of names have changed by selection of the new portion. 
5 The sets have a first set and a number of additional sets, wherein the first set corresponds 
to all of the characters in the alphabet and to values of how many of the characters of the 
alphabet are in the previously selected portion. The values are names for the first set. 
Each additional set comprises names corresponding to selected pairs of names from a 
single other set. Changes in the names are used to determine the permutation patterns. 

10 Each name generally corresponds to a permutation pattern and permutation 

patterns may be found by keeping track of changes to the names. When a name is 
changed greater than or equal to a predetermined value, the permutation pattern 
corresponding to the name may be output. 

A more complete understanding of the present invention, as well as further 

15 features and advantages of the present invention, will be obtained by reference to the 
following detailed description and drawings. 

Brief Description of the Drawing s 

FIG. 1 shows an example of permutation patterns discovered in an 
20 exemplary input string; 

FIG. 2 is an exemplary method for determining permutation patterns, in 
accordance with a preferred embodiment of the present invention; 

FIGS. 3 A and 3B are exemplary naming trees used to describe techniques 
of the present invention; and 
25 FIG. 4 is an exemplary system for determining permutation patterns from 

an input string, in accordance with a preferred embodiment of the present invention. 
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Detailed Description of Preferred Embodiments 

For ease of reference, the present disclosure is divided into the following 
sections: Introduction; The Permutation Pattern Problem; Maximal Patterns; and 
Techniques for Finding Permutation Patterns. 

5 

Introduction 

The present invention allows permutation patterns to be discovered. In 
this disclosure, the abstract problem of discovering permutation patterns is formed as a 
discovery problem called the n pattern problem and techniques that automatically 

10 discover permutation patterns in, for instance, multiple input patterns are given. As there 
is generally not enough knowledge about forming an appropriate model to filter the 
meaningful from the apparently meaningless permutation patterns, a model-less approach 
is taken herein, which allows all permutation patterns that appear a number of times to be 
determined. Additionally, a notation is introduced for maximal permutation patterns that 

15 drastically reduces the number of valid cluster patterns, without any loss of information, 
making it easier to study the results from an application viewpoint. 

The Permutation Pattern Problem 

The permutation pattern problem is described below. A permutation 
20 pattern will sometimes be referred to through a "n pattern" shorthand. 

The section begins by relating some definitions. 

Let S = s\s 2 .~Sn be a string of length «, and P=p\p 2 ...p m a pattern, both 

over alphabet {1,...,|£ |}. 

Definition QT(s), I\!{s)). Given a string s on alphabet 

25 Yl(s) = {a e £ \a = s[i], for some 1 < i < \s\) and 

= {a(t)\a e t is the number of times that a appears in s} 

For example if s=abcda, Tl(s) = {a,b,c,d}> As another example, if 

s=abbccdac, Y\!(s) = {a(2),b(2),c(3),d}. Note that d appears only once and the 

annotations are ignored altogether. 
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Definition of "p-occurs." A pattern P p-occurs, which means that there is 
a permuted occurrence of the pattern, in a string S at location i if: lT(P) = H'(si...Si +m -\). 

Definition of a permutation pattern, called a "n pattern." Given an integer 
K, a pattern P is a % pattern on S if: 
5 |P| > 1, where this step rules out trivial single character patterns; and 

P p-occurs at some k 1 > K distinct locations on S. £ p = {i\ , 12, /*} is the 
location list of p. 

For example, consider YI'(P) = {<z(2),6(3),c(3)} 5 and the string 
S^aacbbxxabcbab. Clearly, P p-occurs at positions 1 and 9. 
10 A problem of n pattern discovery. Given a string S and K < n, find all n 

patterns of S together with their location lists. 

For example, if S=abcdbacdabacb, then P={a,b,c} is a 4-n pattern with 
location list £ p = {1,5, 10, 11}. 

The total number of n patterns is 0(n 2 \ but is this number actually 
15 attained? Consider the following example. 

Let S- abcdefghijabdcefhgij and k = 2. The % patterns shown in FIG. 1 
show that their number could be quadratic in the size of the input. 

Maximal Patterns 

20 A general definition is given below of maximality, and this definition 

holds even for different kinds of substring patterns such as rigid, flexible, with or without 
wild cards. Maximal patterns are also described in Parida, "Some Results on 
Flexible-Pattern Matching," Proc. of the 11th Symp. on Comp. Pattern Matching, vol. 
1848 of Lecture Notes in Comp. Sci., 33-45 (2000), the disclosure of which is hereby 

25 incorporated by reference. 

In the following, assume that p is the set of all n patterns on a given input 

string S. 
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Definitions of "non-maximal" and "maximal" patterns are as follows. 
P a e p is non-maximal if there exists P b € p such that: (1) each p-occurrence of P a on S 
is covered by a p-occurrence of Pb on S (each occurrence of P a is a substring in an 
occurrence of Pb) and, (2) each p-occurrence of P b on S covers /> 1, p-occurrence(s) of 
5 P a on S. A pattern P b that is not non-maximal is maximal. 

Clearly, Yl ( (P a ) cz lT(P&). Although it seems counter-intuitive, it is 

possible that \£ pa \ < \£ pb \. Consider the input S = abcdebca abcde. P a = {d,e} 

p-occurs only two times but P b = {a, b, c, d, e) p-occurs three times and by the definition 
P a is non-maximal with respect to P b . 
10 To illustrate the case of / > lin the definition, consider 

S= abcdbac abcabcd. abcdabc. 

P a = {a,b,c} p-occurs two times in the first and third, and, four times in 
the second p-occurrence of Pb = {(d)2, (6)2, (c)2, d} . Also, by the definition, P a is 
non-maximal with respect to P b . 
15 It is also claimed that such a non-maximal pattern P a can be "deduced" 

from P b and the p-occurrences of P a on S can be estimated to be within the p-occurrences 
of P b - This is shown in more detail below. 

The following can be shown. Let M= {Pj e p\Pj is maximal}. M is 

unique. 

20 This is straightforward to see. This result holds even when the patterns are 

substring patterns. 

In example shown in FIG. 1, pattern P 7 is the only maximal % pattern in S. 

Maximality notation will now be described. Recall that in case of 
substring patterns, the maximal pattern very obviously indicates the non-maximal patterns 
25 as well. For example, a maximal pattern of the form abed implicates ab, be, cd, abc, bed 
as possible non-maximal patterns, unless they have occurrences not covered by abed. Do 
maximal n patterns have such an obvious form? In this section, a special notation is 
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introduced based on observations discussed below. It is then demonstrated how this 
notation makes it possible to represent maximal n patterns. 

Let Q g p and 9= is non-maximal w.r.t. Q}. Then there exists a 

permutation, Q, of Yl (Q) such that for each element Q f s d 9 a permutation of YL l (Q) is a 
5 substring of Q. 

Without loss of generality, let the ordering of the elements be as the one in 
the leftmost occurrence of Q on S as Q. Clearly, there is a permutation of Tl f (Q ') that is a 
substring of Q, else Q' is not a non-maximal pattern by the definition. 

The ordering is not necessarily complete. Some elements may have no 
1 0 order with respect to some others. 

Consider S = abcdef. cadbfe abcdef. Then P\ = {a y b,c, </}, 

p 2 = {e,f} and P3 = {a,b,c,d,e 9 f} are the n patterns with three occurrences each on S. 
Then the intervals denoted by brackets can be represented as 

( 3 (ia, b, c,d)i,( 2 e,f) 2 h, 
15 where the elements within the brackets can be in any order. A pair of brackets (,...), 
corresponds to the n pattern P,. An element is either a character from the alphabet or 
bracketed elements. 

A representation that captures the order of the elements of Q along with 
the intervals that correspond to each Q' encodes the entire set Q. This representation will 
20 appropriately annotate the ordering. The representation using brackets works except that 
there may intersecting intervals that could lead to clutter. When the intervals intersect, 
the brackets need to be annotated. For example, (a(b,d)c) can have at least two distinct 
interpretations: (1) (1^(26, d)ic)\, or, (2) (\a( 2 b,d)ic)2. 

Consider the input string S = abed. deba abed. The n patterns are 

25 Pi = ab, P 2 = be, pi = cd, P4 = abc, P$ = bed, P$ = abed, each occurring three times. 
Using only annotated brackets will yield a cluttered representation as follows: 

(6(1(4^(2(5^)1(30)2)4^3)5)6. 
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The annotation of the brackets is beneficial to keep the pairing of the 
brackets unambiguous. It is clear that if two intervals intersect, then the intersection 
elements are immediate neighbors of the remaining elements. For example, if 
\a(ib,c)\d)2, then (b t c) must be immediate neighbors of (a) as well as (d). If a symbol 
5 4 - 4 is introduced to denote immediate neighbors, then the intervals never intersect. 
Further, they do not need to be annotated if they do not intersect. Thus the previous 
example can be simply given as a-(b,c)-d. The earlier cluttered representation can be 
cleanly put as the following: 
a-b-c-d. 

10 Next, consider the example shown in FIG. 1. Using the notation, there is 

only one maximal n pattern given by M=a-b-(c,d)-e-f-(g,h)-i-j at locations 1 and 11 on 5. 
Notice that II{Pi) = II(M) and every other n pattern can be deduced from M. 

Techniques for Finding Permutation Patterns 

When finding patterns, the input is generally a set of strings of total length 
n. In order to simplify the explanation, one string S of length n over an alphabet £ will 
be considered. It should also be noted that each string can comprise sets of characters at 
each location in the string. However, for simplicity, one character per location will be 
described herein. 

The techniques presented below compute the maximal n patterns in S. 
The maximal n patterns can be determined in two stages: (1) find all the n patterns in S, 
and (2) find the maximal n patterns in S. In an exemplary implementation, in Stage 2, a 
straightforward computation is used that uses location lists of all the n patterns in S 
obtained at Stage 1. The location lists of each pair of n patterns are checked to find if one 
n pattern is covered by another one. Assume that Stage 1 outputs p n patterns, and the 
maximum length of a location list is /, Stage 2 runs in 0(p 2 l) time. From now on, only 
Stage 1 will be discussed. 



15 



20 



25 
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It is assumed that the size of the longest pattern is Z. Step / of Stage 1, 
where 2 < / < Z,, finds n patterns of length /. Stage 1 is described broadly by the method 
of FIG. 2. Steps of method 100 will be described broadly, then more detailed description 
of the steps will be given. 
5 Method 100 of FIG. 2 selects a window size (step 110), and then moves a 

window of size / along string S, adding and deleting a letter in each iteration. In step 115, 
the window 170 is placed at the beginning of the string S, as shown by reference 155. In 
this example, the window size, /, is four. 

A naming tree, described in detail below, is updated in step 120. It should 

10 be noted that this step can include determining new names. In step 125, a search is made 
for updated names in the naming tree. It is this search that lessens the time spent while 
determining n patterns. Counters are updated in step 130 for the updated names. This 
step may also comprise updating location lists. In step 135, it is determined if the end of 
the string has been reached. If it has not (step 135 = NO), then the window 170 is moved 

15 one character to the right (in this example), as shown by reference 160. Method 100 
continues until the end of the string is reached (step 135 = YES), when the window size is 
changed in step 140. If the window size is not greater than the size of the string (step 145 
= NO), method 100 continues in step 110. If the window size is greater than the size of 
the string, the method ends in step 150, where the patterns that appear greater than K 

20 times are output as permutation patterns. 

Method 100 will now be described in more detail. 

The method 100 maintains, in step 120 for instance, an array NAME 
[1—1 2 |] where NAME/#/ keeps count of the number of appearances of letter q in the 
current window. Hence, the sum of the values of the elements of the NAME array is /. In 
25 each iteration the window shifts one letter to the right, and at most 2 variables of the 
NAME array are changed: one is increased by one (e.g., adding the rightmost letter) and 
one is decreased by one (e.g., deleting the leftmost letter of the previous window). 

Note that for a given window s a s a + l...s a +i-\ the NAME array represents 
Tl'isaSa+i-.-Sa+i-i ). There is one difference between the NAME array and 11', and that is 
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that in IT only the letters of n are considered and, in the NAME array, all letters of £ 
are considered, but the values of letters that are not in U are zero. At iteration j of steps 
115 through 135, the NAME array is defined to represent the substring sj...Sj+i-i . 

An observation can be made that substrings of S, of length /, that are 
5 permutations of the same string are represented by the same array NAME. 

It has been explained how the NAME arrays of all substrings of length / of 
S are computed. The NAME arrays that appear more than K times still need to be found. 

In an embodiment of the present invention, each distinct NAME array is 
given a unique name, which is an integer in the range 0...n, The choice of assigning an 
10 integer is arbitrary, as any code could be used for a name. The names are given by using 
the naming technique, described below. 

A suitable naming technique is described as follows. Assume, for the sake 
of simplicity, that 1 2 | is a power of 2. (If | Z I is not a power of 2, the NAME array can 
be extended to an appropriate size by concatenating to its end repeated -1 . The size of the 
15 resulting array is no more than twice the size of the original array.) 

A name is given to each subarray of size 2 1 that starts on a position jl l + 1 
in the array, where 0 < i < log 1 2 1 and 0 <j < | 2 Names are given first to subarrays of 
size 1 then 2,4,... 1 2 1, at the end a name is given to the entire array. 

A subarray of size 2' is a concatenation of 2 subarrays of size 2 M . The 
20 names of these 2 subarrays are used as the input for the computation of the name of the 
subarray of size 2'. The process may be viewed as constructing a naming tree, which can 
be considered, in an exemplary embodiment, to be a binary tree. The naming tree has a 
number of levels. The leaves of the tree (e.g., at level 0, as shown below) are the 
elements of the initial array. Node x in level i is the parent of nodes 2x -1 and 2x in level 
25 f-7. 

An exemplary naming strategy is as follows. A name is a pair of previous 

names. At level j of the naming, we compute the name of subarray NAME\NAME 2 of 

size 2 J 9 where NAME\ and NAME 2 are consecutive subarrays of size 2 J ~ { each. In an 

exemplary embodiment, names are given as natural numbers in increasing order. Notice 
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that every level only uses the names of the level below it, thus the names used at every 
level are numbers from the set {l,...,n}. 

To give an array a name, it is only necessary to know if the pair of names 
of the composing subarrays has appeared previously. If it did, then the array gets the name 
5 of this pair. Otherwise, it gets a new name. It is necessary, therefore, to show a quick way 
to dynamically access pairs of numbers from a bounded range universe. 

An example will help to explain this. Let the alphabet be as follows: 
I = { a, b, c, d, e,f, g, h, ij, kj 9 m 9 n, o,p} , 1 2 1 = 1 6. Assume a substring cboljikgikl of 5, 
the NAME that represents this substring is as shown in FIG. 3A. The term NAME refers 

10 to row 250 and each entry in rows 210-240. Each name also represents a pattern, which 
will be used to determine permutation patterns (e.g., patterns that occur >K times). 
Additionally, the rows 210-250 can be considered sets of names. The row 250 has the 
leaves, and each entry 250-1 through 250-16 corresponds to a character of the alphabet. 
For instance, entry 250-1 has a value of zero and corresponds to the number of characters 

15 V there are in the substring. Entry 250-2 has a value of one and corresponds to the 
number of characters "6" there are in the substring. Similary, entry 250-9 has a value of 
two and corresponds to the number of characters "f there are in the substring, while entry 
250-16 has a value of zero and corresponds to the number of characters "p" there are in 
the substring. The entry 240-1 is a name assigned to the value "01" from the pair 250-1 

20 and 250-2. Similarly, the entry 230-1 is a name assigned to the value "43" from the pair 
240-1 and 240-2. 

Suppose the window move adds the character n. (It should be noted that no 
character drops off in this example; instead the window grows in size to encompass the 
character n.) In the diagram shown in FIG. 3B, the names that changed as a result of the 
25 change to the naming tree are shown in shading. 

From this example, one can see that a single change in the array NAME 
causes at most 1 1 1 names to change, since there is at most one name change in every level 
210 through 250. 
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It can be shown that at every iteration, only <9(log | X |) names need to be 
handled, since only two elements of array NAME are changed. 

It has been shown that the name of the NAME array can be maintained at a 
cost of 0(log 1 2 1) per iteration. What should be found is whether the updated NAME 
5 array gets a new name, or a name that appeared previously. Before an efficient 
implementation of this task is shown, the maximum number is bound for different names 
needed to generate for a fixed window size /. 

It can be shown that the maximum number of different names generated 
by the techniques of the present invention's naming of size / window on a text of length n 
10 is 0(wlog|£|). The maximum number of names generated at a fixed level j in the 
naming tree is 0(n). 

A pair recognition problem is now discussed. It was shown earlier that it is 
beneficial to show a quick way to dynamically access pairs of numbers from a bounded 
range universe. Formally, a solution to the following problem is to be found: 
1 5 The dynamic pair recognition problem is the following: 

INPUT: A sequence of queries {(aj, bj)}f =x where a,, bj e {1, ... J}. 

OUTPUT: Dynamically decide, for every query {a h bj), whether there exist 
c, c<i such that (a,, bj) = (a c , 6 C ). 

At any point j, the pairs being considered all have their first element no 
20 greater than j. Thus, accessing the first element can be done in constant time by direct 
access. This suggests "gathering" all pairs in trees rooted at their first element. However, 
if it can be assured that these trees are ordered by the second element and balanced, 
elements can be found by binary search in time that is logarithmic in the tree size. 

The above solution, for the pair recognition problem, can be determined, 
25 when solving each query (a y ,6 y ), through a search on a balanced search tree with all 
previous queries whose first pair element is aj. Since in every level there are at most O(n) 
different numbers, the time for searching such a balanced search tree is 
OQog\BAL[a\\) = 0(log(«)). Balanced search trees are described in Introduction to 
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Algorithms, T. Cormen, C. Leiserson, and R. Rivest, MIT Press, 381-399 (1991), the 
disclosure of which is hereby incorporated by reference. 

The above technique gives names to many parts of NAME. Special 
attention is given to leaves, in the balanced search trees, that represent names of the entire 
5 array NAME. In other words, a leaf could represent one row 250 of FIG. 3. In Step / of 
method 100 of FIG. 2, all the patterns of one n pattern will reach the same leaf. A 
counter can be added to each leaf that finds if the number of occurrences is at least K. 
Additionally, a location list can be added to each leaf. 

The time complexity of Stage 1, method 100 of FIG. 1, may be computed 
10 as follows. Stage 1 runs L times. In a step /, NAME and the naming tree are initialized in 
0(1 + 1 2 1) time and then compute n-l iterations are computed. Each iteration includes at 
most two changes in NAME, and the computation of <9(log | £ |) names. Computing a 
name takes 0(\ogn) time. Hence the total running time of Stages 1 and 2 is 
0(Ln log|E|log«). 

15 Turning now to FIG. 4, an exemplary computer system 300 is shown for 

determining permutation patterns, in this example maximal permutation patterns 340, 
from an input string 340. Computer system 300 comprises a processor 310 coupled to 
memory 315, which comprises a pattern discovery process 320, a naming tree 325, 
counters 330, location lists 335, and database 337. The pattern discovery process 320 

20 takes one or more input strings 305 and determines maximal permutation patterns 340, as 
described above. The pattern discovery process 320 performs Stages 1 and 2 as described 
above. In the example of FIG. 1, the counters are used to store how many times each 
named pattern occurs and are stored separately, in this example, from the location lists 
335 and naming tree 325. The location lists 335 tell where the patterns occur. As 

25 described above, one way to implement naming tree 325, counters 330, and location lists 
335 is through a balanced search tree 345. Balanced search tree 345 comprises a number 
of nodes 350-1 through 350-5, of which nodes 350-2, 350-3, and 350-5 are leaves. 

Database 337 may be used to store results from previous calculations using 
the present invention. Database 337 may be used, for instance, in the following manners. 
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Given a database 337, A and a query sequence s, then D may be used to check how 
similar s is to zero elements, one element or several elements in D. The similarity could 
be in terms of "local composition." This translates to finding permutation patterns that are 
common to s and D. Then the techniques of the present invention may be used to detect 
5 these regions of similarity. 

The present invention described herein may be implemented as an article 
of manufacture comprising a machine-readable medium, as part of memory 315 for 
example, containing one or more programs that when executed implement embodiments 
of the present invention. For instance, the machine-readable medium may contain a 

10 program configured to perform steps in order to perform Stages 1 and 2 described above. 
The machine-readable medium may be, for instance, a recordable medium such as a hard 
drive, an optical or magnetic disk, an electronic memory, or other storage device. 

It is to be understood that the embodiments and variations shown and 
described herein are merely illustrative of the principles of this invention and that various 

15 modifications may be implemented by those skilled in the art without departing from the 
scope and spirit of the invention. 
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